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Executive Summary 



In April 2007, Federal No Child Left Behind regulations were finalized that provided states with 
additional flexibility for assessing some students with disabilities. The regulations allowed states 
to offer another assessment option, alternate assessments based on modified academic achievement 
standards (AA-MAS). States are not required to have this assessment. According to the regulations, 
this option is for a small number of students with Individual Education Programs (lEPs) who even 
with appropriate grade level academic instruction are unlikely to reach grade-level proficiency 
within the year covered by an lEP 

The National Center on Educational Outcomes (NCEO) has been tracking and analyzing the char- 
acteristics of states’ AA-MAS since 2007. This is the second annual update. The previous NCEO 
report on test design for AA-MAS (Eazarus, Thurlow, Christensen & Cormier, 2007) indicated that 
five states offered an assessment they considered to be an AA-MAS in 2007: Kansas, Eouisiana, 
North Carolina, North Dakota, and Oklahoma. In addition, Maryland indicated it was in process 
of developing an AA-MAS. In 2008, there were three more states that had an assessment they 
considered to be an AA-MAS: California, Connecticut, and Texas. As of March 2009, none of the 
states had successfully completed the U.S. Department of Education’s peer review process. As of 
the publication date, one state (Texas) had received approval. 

States’ AA-MAS’s differed in a number of ways from their regular assessments. In 2008, the AA- 
MAS of all nine states used a multiple-choice format. Some states’ assessments also included con- 
structed response or writing prompts. And in 2008, two states included performance-based tasks. 
Design elements differentiating the AA-MAS from a state’s regular assessment included fewer items 
on the test, removing a distractor, shorter passages, fewer passages, and simplified language. More 
than half of the states had fewer items per page on the AA-MAS than on the regular assessment. 
Analysis of states’ regular assessment blueprints compared to those of AA-MAS showed some dif- 
ferences in the patterns of emphasis across grade levels. 
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Overview 



Federal No Child Left Behind (NCLB) regulations finalized in April 2007 provided states an- 
other assessment option to consider in meeting the goal of including all students in the federal 
accountability system. In addition to the previously-available assessment options for students 
with disabilities (e.g., taking the regular assessments with or without accommodations, or al- 
ternates based on grade level or alternate achievement standards), the regulation gave states the 
flexibility to offer an alternate assessment based on modified academic achievement standards 
(AA-MAS). States may count up to 2% of all students as proficient who met proficiency stan- 
dards with an AA-MAS (U.S. Department of Education, 2007, April 9). States are not required 
to offer an AA-MAS. 

According to the 2007 regulations, students participating in an AA-MAS must have an lEP; and 
even with appropriate grade level content instruction, the student must be unlikely to achieve 
proficiency in the year covered by an lEP. Eurther, the students participating in an AA-MAS 
may be from any disability category (U.S. Department of Education, 2007, April 9). As of the 
publication date, only one state (Texas) that had an assessment it considered to be an AA-MAS 
successfully completed the peer review process used by the U.S. Department of Education to 
determine whether the assessment satisfies federal requirements. The purpose of this report is 
to compare the characteristics of assessments states identified as AA-MAS in 2007 with those 
assessments identified in 2008. 

In 2007, the National Center on Educational Outcomes (NCEO) tracked and analyzed states’ 
participation guidelines for the AA-MAS and the characteristics of states’ AA-MAS (Eazarus, 
Thurlow, Christensen, & Cormier, 2007). Because more information is now publicly avail- 
able, NCEO is publishing two separate updates — this report on the characteristics on states’ 
AA-MAS (including assessment design changes) and another synthesis report on participation 
guidelines (Eazarus, Rogers, Cormier, & Thurlow, 2008). This report builds on the work done 
in the NCEO report. States ’ Alternate Assessments Based on Modified Achievement Standards 
(AA-MAS) in 2007 (Synthesis Report 67) (Eazarus et ah). The current report covers assessment 
design changes, as did the previous report, but with additional analyses including a blueprint 
comparison between regular assessments and AA-MAS. 

Questions guiding the current study were: 

1. In August 2008, which states had an assessment that they considered to be AA-MAS? 

2. What were the characteristics of these assessments and how had they changed since 2007? 
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3. What differences, if any, were there between the assessment blueprints of states’ regular and 
AA-MAS assessments regarding number of items and the percentage that specific components 
(e.g., strands) were covered in subject areas by grade? 

Process Used to Find Information about States’ AA-MAS 

This report summarizes publicly available information about the characteristics of the AA-MAS 
for states that either had an assessment they considered to be this type of alternate assessment 
in place in August 2008, or had information about an AA-MAS in development on the state 
Web site in August 2008. 

Data were gathered from state department of education Web sites by locating all available in- 
formation on AA-MAS and regular assessments, including general information, frameworks, 
test specifications, and accommodation policies. Data were gathered on assessment design 
changes (e.g., AA-MAS question types and characteristic changes) that had been included in the 
previous year’s report (Lazarus et ah, 2007) to compare changes between 2007 and 2008. This 
report includes information on accommodations that have been incorporated into the design of 
states’ AA-MAS. For this report we define embedded accommodations as AA-MAS features 
that would be considered an accommodation on a state’s regular assessment. In other words, if 
a tool or procedure that is usually considered an accommodation is provided on the AA-MAS 
(and is available to students participating in the assessment without any lEP documentation), it 
is considered an embedded accommodation. We looked at accommodations that were allowed 
on each state’s regular assessment, as well as regular test features that are sometimes consid- 
ered accommodations — and then looked to see whether any of these accommodations had been 
integrated into the design of the state’s AA-MAS. Examples of embedded accommodations 
are listed below: 

• If a state’s AA-MAS used 16-point font size and its regular assessment had 12-point font, 
the large print accommodation would be considered to be an embedded accommodation. 

• If the calculator was allowed on all sections of a state’s AA-MAS but allowed only on 
certain portions of the regular test, the calculator accommodation would be considered an 
embedded accommodation. 

• If a state’s AA-MAS design included the reading of test questions and items to all partici- 
pating students (and the regular assessment does not include this feature), the read aloud 
accommodation would be considered an embedded accommodation. 

Note that this report only includes information on embedded accommodations that have been 
incorporated into the design of the AA-MAS. Detailed information on state’s accommodations 
policies for the AA-MAS will be included in a forthcoming report. 
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A comparison was also made between blueprints for states’ AA-MAS and the general state as- 
sessments found on state Web sites. The areas of comparison included content area changes by 
grade ranges, elementary to high school. For this analysis, we used samples taken for elementary 
(4*), middle (8*) and high school (10*) grades for all subjects reported. We limited our analysis 
to multiple choice items because only two states had constructed response items (other than for 
writing). If information for any of these grades was not available, the grade below it was used. 
If there were no assessments in the grade below, information was gathered for the grade above. 
A complete list of state documents used to compile information for this report is in Appendix A. 

The AA-MAS information collected for each state was placed into a state profile in the form of 
summary tables. The profiles were then e-mailed to each state in September 2008. States were 
asked to verify the information; if the profile contained inaccurate information, states were 
permitted to revise their profiles, providing we could confirm their corrections with posted state 
information. Five states responded to the request; they either confirmed the accuracy of the 
information, suggested one document over another, or filled in other information. The verified 
information was then compiled and summarized in this report. 

Results 

In July 2007, there were five states that offered an assessment that the state considered to be an 
AA-MAS (Lazarus et ah, 2007). These were Kansas, Louisiana, North Carolina, North Dakota, 
and Oklahoma. At that time, Maryland had publicly available information indicating that it 
was developing an AA-MAS so it was also included in the 2007 report (Lazarus et ah, 2007). 
In 2008, there were three additional states either implementing or in the process of developing 
an AA-MAS. The states were California, Connecticut, and Texas. Table 1 lists all nine of the 
states that either were developing or had what they considered to be an AA-MAS in 2008, and 
provides brief details about each assessment (e.g., content areas and grades assessed). 

Figure 1 shows the number of states employing different types of question and assessment ap- 
proaches between 2007 and 2008. The total number of states for each category graphed takes into 
account all subject areas. For example, if a state used multiple choice and constructed response 
questions in one subject area, the state would be counted in both categories. But a category such 
as multiple choice would not be counted twice if it was used for both reading and mathematics. 
Four states used a combination of question types within a content area assessment. 

There were also some observed differences in assessment design characteristics from the pre- 
ceding year. North Dakota had a performance-based portfolio assessment in 2007 (Lazarus et 
ah, 2007). In 2008, this assessment had evolved into a teacher mediated computer delivered 
performance-based assessment that used a multiple choice format. Specific information on as- 
sessment types and question characteristics for each subject area are provided in Table B 1 in 
Appendix B. 
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Table 1. AA-MAS Name, Content Areas, and Grade Described by State 



State 


Assessment Name 


Content Areas/Grades 


California 


California Modified Assessment (CMA) 


ELA(3-8); Math (3-7); Science (5,8) 


Connecticut^ 


CMT/CAPT Modified Achievement 
Standards (CAPT-MAS) 


ELAand Math (3-8,10-11) 


Kansas 


Kansas Assessment of Multiple 
Measures (KAMM) 


Reading and Math (3-8; once in HS), 
Writing (5,8, once in HS); History/Gov 
(6,8, once in HS); Science (4,7, once in 
HS) 


Louisiana 


LEAP Alternate Assessment, Level 2 
(LAA2 ) 


English and Math (Grades 4-10); Science 
and Social Studies (4, 8, 11) 


Maryland^ 


Modified Maryland School Assessment 
(Mod-MSA) and Modified High School 
Assessment (Mod-HSA) 


Reading/ELAand Math (3-8, HS) 
(Information in report and appendices is 
for Mod-HSA only.) 


North Carolina 


NCEXTEND2 


Reading and Math (3-8); Science (4,8,11) 


North Dakota 


North Dakota Alternate Assessment 
Aligned to North Dakota Content 
Standards for Students with Persistent 
Cognitive Disabilities (NDAA2) 


Reading and Math (3-8); Science (4,8,11) 


Oklahoma 


Oklahoma Modified Alternate 
Assessment Program (OMAAP) 


ELA/Reading and Math (3-8, HS); 
Science (5,8) 


Texas 


Texas Assessment of Knowledge and 
Skills, Modified (TAKS-M) 


English and Math (3-11); Science (5,8,10- 
11); Writing (4,7,10); Social Studies (8,10- 
11) 



^Under development, Connecticut plans to implement in 2008-09. 



^Under development. Maryland plans to implement its AA-MAS in 2008-09 at the earliest. 



Figure 1 . Number of States by Assessment Type and Question Characteristics Across Study Years 
Multiple Choice . 
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■ 2008(N=9) 
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‘North Dakota used a portfolio assessment for its AA-MAS at the time of the 2007 report. Over time it has evolved into a 
teacher-mediated multiple choice and performance task assessment. 
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Assessment Design Changes 



Figure 2 shows the number of states with specified design changes across the two years. Most 
states noted using fewer items (n=8), followed by removing a distractor (n=6), shorter passages 
(n=5), and simplified language (n=5). Segmentation of passages was noted by one state in 2007 
and by three states in 2008. See Tables B2 and B3 in Appendix B for more detailed information 
about design changes, including other changes made by only one state that are not included in 
the figure. 

Figure 2. Selected Design Changes in States’ AA-M AS Across Study Years 



Distractor Removed 
Fewer Items 
Fewer Passages 
Segmentation of Passages 
Shorter Passages 
Simplified Language 

0123456789 
Number of States 



1 1 1 












- — 1 — 1 — 1 — 










g 


■ — 1 — 1 — 














- 


- 


- 


3 












- 




D 










D 






i 



□ 2007 (N=6) 
D2008 (N=9) 



Embedded Accommodations 

States often embedded accommodations into their AA-MAS assessments features that typically 
appear as accommodations in states’ policies. In Figure 3, five states were using fewer items per 
page and four used larger font sizes. One state embedded the calculator accommodation. See 
Tables B4 and B5 for additional information about embedded accommodations and for more 
detailed specifications. 

Other accommodations found in state policies were incorporated into the AA-MAS of a single 
state only for this year’s study (see Table B-3 of Appendix B). Accommodations incorporated into 
the AA-MAS design by only one state included having a scribe for all students (North Dakota), 
reading aloud questions and answers for all students (Texas), and incorporating manipulatives 
into the assessment (North Dakota). 



NCEO 



5 






Figure 3. Accommodations Incorporated into AA-MAS Across Study Years^ 




□ 2007 (N=5) 
■ 2008 (N=9) 
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^ Two of the nine states tracked in 2009 (e.g., Connecticut and Maryland) were still in the process of developing 
their AA-MAS. Therefore, there was minimal information available regarding embedded accommodations for 
those two states. 



One state made an interesting change between our 2007 and 2008 analyses. The official Kansas 
policy regarding calculators did not change — for both years there were the same allowable ac- 
commodations for the regular test and the KAMM (the AA-MAS in Kansas) — and calculators 
were not allowed on the non-calculator portion of a test. However, the Kansas documents used 
for the analysis in 2007 went on the say: 

Calculator use on non-calculator portions of the assessment is not allowed for any 
student. However, at this time there are no non-calculator portions on the KAMM 
assessment. Therefore, because of the current KAMM test design, calculators 
and calculation devices such as math tables are allowed on the entire KAMM. 

But by 2008, Kansas was in the process of changing their KAMM, and 2008 Kansas documents 
indicated that: 



KAMM Math Assessment will be reorganized this year based on the April 2007 
release of the final NCLB 2% Regulations. The revised KAMM Math assessment 
will mirror the organization of the current Kansas General Math Assessment in 
the following way. 
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• The KAMM Math Assessment will be organized into three seetions. 

• The use of calculators will be allowed in two sections. 

• The third section will not allow calculator use. 

• In the non-calculator portion, there are numerous items, approximately 50% (depending 
on the grade level), for which a calculator is not necessary (e.g., recognizing shapes, 
charts and graphs, time, transformations, etc.). 

Therefore, in 2007 the results of our analysis showed that Kansas incorporated the calculator 
accommodation into their AA-M AS test design (since it was allowed on all sections of the AA- 
MAS), but that in 2008 the state did not incorporate the accommodation since it was allowed 
on two out of three sections of both assessments. 

Assessment Blueprints Comparison 

Information was also gathered from state blueprints for regular assessments and AA-MAS to 
compare the number of test items and the percentage of coverage for components of subject area 
assessments. These data are presented in full — for representative elementary, middle school, 
and high school grades — in Appendix C. Appendix C also includes more specific assessment 
information such as when a state has indicated that certain items for an assessment are drawn 
from multiple grade levels. For example, California in its elementary science assessment for 5* 
grade uses a certain number of items from 4* and 5* grade content in both its regular assess- 
ment and AA-MAS. 

Table 3 displays the differences in the number of total multiple choice items on states’ AA-MAS 
compared to the regular assessment. This table is based on detailed information in Appendix 
C (Tables C1-C3 provide information on elementary reading, math, and science, respectively; 
Tables C4-C6 are middle school reading, math, and science; Tables C7-C9 are high school 
reading, math, and science. Table CIO provides information on the number of items for social 
studies). Differences in numbers of items do not address content or difficulty of items, nor do 
they address the rich information found in performance level descriptors. A separate report 
that provides information on performance level descriptors used by states with an AA-MAS is 
forthcoming. 
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Table 3. Total Numbers of Multiple Choice Items^ on AA-MAS and Regular Assessment, and 
Percentage of Regular Items Represented on AA-MAS 



State 


Elementary 


Reading/ELA^ 


AA- 

MAS 


Reg 


% of Reg 


California 


27 


42 


64% 


Kansas 


36 


743 


49% 


Louisiana 


21 


33 


64% 


North Carolina 


40 


58 


69% 


Oklahoma 


40'* 


50 


80% 


Texas 


32 


40 


80% 


Math 








California 


48 


65 


74% 


Kansas 


40 


72:* 


56% 


Louisiana 


42 


60 


70% 


North Carolina 


40 


82'* 


49% 


Oklahoma 


40'* 


45 


89% 


Texas 


34 


42 


81% 


Science 








California 


48 


60 


80% 


Louisiana 


35 


40 


85% 


North Carolina 


60 


OO'' 


75% 


Oklahoma 


414 


45 


91% 


Texas 


32 


40 


80% 










Social Studies 
(HS) 








Kansas 








Louisiana 








Texas 
















Writing 








California 


21 


33 


64% 


Texas 


24 


28 


86% 



Middle School 


AA- 

MAS 


Reg 


% of Reg 


30 


42 


71% 


48 


84^ 


57% 


21 


33 


64% 


40 


53 


75% 




50 




38 


48 


79% 








54 


65 


83% 


40 


88'* 


45% 


42 


60 


70% 


40 


80^ 


50% 


40^" 


45 


89% 


40 


50 


80% 








54 


60 


90% 








60 


OO'' 


75% 


40'* 


45 


88% 


40 


50 


80% 














49 


60 


82% 








38 


48 


79% 














24 


33 


73% 


32 


40 


80% 



High School 


AA- 

MAS 


Reg 


% of Reg 








48 


64 


75% 


21 


33 


64% 


40 


56 


71% 


32'* 


48'* 


67% 


22 


28 


79% 














40 


104 


38% 


42 


60 


70% 


40 


OO'* 


50% 


40 


55 


73% 


45 


56 


80% 














35 


40 


88% 


40 


OO'* 


50% 


46'* 


60 


76% 


44 


55 


80% 














52 


60 


87% 


32 


60 


53% 


44 


55 


80% 




















14 


20 


70% 



^Multipe choice items only. Does not include constructed responses items or essays. 

^This table does not include any writing multiple choice items in Reading/ELA. See separate listing for writing. 

^ Documents noted that the regular assessment included field test items. Field test items could not be disaggregated 
from other test items for the regular assessment. 

''Median number of questions 

Note: The matrix cells are shaded if the number of items on the AA-MAS is less than 60% of the items on the regular 
assessment. 
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Table 3 presents a detailed comparison of the number of multiple choice items on states’ AA- 
MAS and the regular assessment for states that have publicly available information. The great- 
est difference in number of items between the AA-MAS and regular assessment are shaded 
in Table 3 (i.e., if a state’s AA-MAS has less than 60% of the number of items on its regular 
assessment). Shading indicates greater difference in coverage between the two assessments. 
States with the largest number of multiple choice items on the regular assessment tended to 
have the largest difference in percentage of total items between the AA-MAS and the regular 
assessment. In some cases, however, we observed a comparable percentage difference even with 
a relatively modest number of items on the regular assessment. An example of a state that had 
a relatively large number of multiple choice items on its regular assessments is Kansas. The 4* 
grade level KAMM reading assessment had 58 items. This compared to 36 questions on its 4* 
grade AA-MAS for reading. As shown in Appendix Table C 1 , an additional 1 6 multiple choice 
questions are used for the 4* grade AA-MAS in reading, but some of these are field test items 
for future use. Thus, the AA-MAS had 62% as many items as the regular assessment, assuming 
the regular assessment items were all operational. For most content areas and at most grade 
levels Oklahoma and Texas had the smallest percentage difference in the total number of AA- 
MAS items compared to the regular assessment. See Tables C 1-C 10 in Appendix C for detailed 
information about the number of items. 



Example of State with Differences Across Component Areas 

Not all states with AA-MAS reported the number of items or percentage of components for 
various “strands” within a content area for its regular assessment and its AA-MAS. Among 
those that did, some differences were observed. An example of the type of dilFerences between 
the regular assessment and the AA-MAS across strands in one state is provided here. It shows 
changes in the pattern of coverage within mathematical components across grades 4, 8, and 10. 

As shown in Figure 4, at the elementary level there is a dilFerence in the pattern of the percentage 
of items for strands on the AA-MAS compared to the regular assessment, with a 20% dilFerence 
in number and number relations on the AA-MAS compared to the regular assessment. Geometry 
had the smallest percentage dilFerence oF 4%. For other strands the difference in percentage 
of items ranged from 2-11%. The state’s AA-MAS appears to be designed to include a range 
of 15-20% of the total questions for each strand assessed, but this pattern does not match the 
emphasis for the regular assessment, which varies between 5% and 40% of the total questions 
across strands. 
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Figure 4.State Example: Elementary Math Percentage of Total Number of Questions Devoted to 
Each Strand for AA-MAS and Regular Assessment 
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Note: This figure reports percentages rather than number of items. At the elementary level, the state’s AA-MAS 
had 42 multiple choice items and 2 constructed response items. The state’s regular assessment had 60 multiple 
choice items and 3 constructed response items. 



Figure 5 presents the middle sehool percentages for the same state. The percentage of the state’s 
assessment questions for each strand at the middle school level was similar to percentages for 
the AA-MAS at the elementary level — and also quite similar to the state’s regular assessment 
at this level. 



Figure 6 shows the comparison at the high school level. This comparison also shows little 
variation between the regular assessment and the AA-MAS, with a range of 1-10% of total 
questions across strands. The AA-MAS, again, has the same percentage for each strand as at the 
elementary and middle school levels. Most noticeable here is the difference between number 
and number relations with 10% more items in this area on the AA-MAS than on the regular as- 
sessment (i.e., 20% of the questions on the AA-MAS were “number sense” questions but only 
10% of the questions on the regular assessment were devoted to this strand). 

States’ blueprints for the regular assessment and the AA-MAS for all content areas that were 
publicly available were compared for elementary, middle, and high school assessments. Sum- 
mary information and examples are provided here, with details presented in Appendix C. We 
examined all content areas for which blueprints were available (e.g., reading, writing, math, 
science). 
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Figure 5. State Example: Middle School Math Percentage of Total Number of Questions 
Devoted to Each Strand for AA-MAS and Regular Assessment 




Note: This figure reports percentages rather than number of items. At the middle school level, the state’s AA- 
MAS had 42 multiple choice items and 2 constructed response items. This state’s regular assessment had 60 
multiple choice items and 4 constructed response items. 



Figure 6. State Example: High School Math Percentage of Total Number of Questions Devoted 
to Each Strand for AA-MAS and Regular Assessment 




Note: This figure reports percentages rather than number of items. At the high school level, the state’s AA-MAS 
had 42 multiple choice items and 2 constructed response items. This state’s regular assessment had 60 multiple 
choice items and 4 constructed response items. 
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Discussion 



In 2007, six states either had or were in the process of developing an assessment they considered 
to be an AA-MAS. In 2008, there were nine states, and as of the publication date only one of 
the states has successfully completed the federal peer review process. Similar to 2007, multiple 
choice items were the predominant type of item on states’ AA-MAS in 2008. Only two states 
used constructed response items, other than in writing where some states used prompts. Two 
states used performance tasks, one for the entirety of the AA-MAS (North Dakota) and one only 
for a science portion (Kansas). The three states added in this report showed similar designs in 
their AA-MAS to the six states that had this assessment option in 2007 — for example, fewer 
items, simplified language, removal of a distractor, and shorter and fewer passages. States had 
other unique design features in both years, but many of these were difficult to categorize because 
they focused on the presentation of specific item content. 

Several features that were considered accommodations for the state’s regular assessment were 
embedded into the design of some states’ AA-MAS. In 2008, the most frequently embedded 
accommodations were fewer items per page and larger font size. Both of these accommodations 
generally are categorized as presentation accommodations for regular assessments. 

In this analysis of AA-MAS, we found for the first time that a state incorporated the use of scribes 
into the AA-MAS design. In contrast, other states considered a scribe a separate accommodation 
available for students on the AA-MAS or regular assessments if they individually required one. 

The different characteristics observed in these AA-MAS seem to show that assessments across 
states are targeting different students. This observation agrees with Filbin (2008), who noted 
that states either appeared to be targeting students right below the regular assessment or right 
above the alternate assessment based on alternate achievement standards. In our analysis, some 
states appeared to have fewer changes to blueprints, suggesting these states’ AA-MAS may be 
geared toward those students just below the regular assessment. 

Comparing blueprints can yield useful information on how content coverage may differ across 
the assessments (Marion, 2007). The April 2007 Federal Register Rules and Regulations, in 
describing assessment design compared to regular content standards, said that an AA-MAS 
“refiects the same degree and pattern of emphasis as the content standards (balance)” (Section 
200.6(a)(3)(i)), p. 2). But, in the Standards and Assessments Peer Review Guidance revised 
December 21, 2007, possible examples of acceptable evidence included a comparison of blue- 
prints that “indicates that the general assessment and the assessment based on modified academic 
achievement standards were designed to address the same grade level content standards although 
the item specifications differ” (p. 26). The example showing the comparison of strands for the 
AA-MAS and regular assessment in one state refiects that state’s interpretation of “balance.” 
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In that example, the state maintained the same pereentage of items aeross eomponents at all 
grades, even though this sometimes was divergent from the pereentage assessed in those grades 
on its regular assessments. It appears that states may have very different interpretations of what 
is meant by “same degree and pattern of emphasis.” 

In summary, it is important to eontinue to traek the ehanges and deeisions made by states as they 
develop their AA-MAS for students who qualify to partieipate. As states pursue the AA-MAS 
option, all aspeets of the assessments should be analyzed and doeumented, toward the goal of 
ensuring quality grade level assessment and aeademie instruetion for all students. 
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Appendix A 



State Documents Used in Analysis 

state Documents and Presentations Used in the Anaiysis of States’ AA-MAS 



California 


California Department of Education (n.d.). cma37math. Retrieved on August 7, 2008 from 
http://www.cde.ca.gov/ta/tg/sr/cmablueprints.asp . 

California Department of Education (n.d.). cma38ela. Retrieved on August 7, 2008 from 
http://www.cde.ca.gov/ta/tg/sr/cmablueprints.asp . 

California Department of Education (n.d.). cmasciblueprints. Retrieved from on August 7, 
2008 from http://www.cde.ca.gov/ta/tg/sr/cmablueprints.asp . 

California Department of Education (n.d.). Differences between CST and CMA, downloaded 
August 7, 2008 from http://www.cde.ca.gov/ta/tg/sr/cmastar.asp 

California Department of Education (January, 2008). Appropriate test variations and 
accommodations for the 2008 administration of the California Modified Assessment (CMA) 
based on the study of item format and delivery mode from the CMA. Retrieved on August 7, 
2008 from http://www.cde.ca.gov/ta/tg/sr/cmastar.asp . 

California Department of Education. (2007). 2008 standardized testing and reporting item 
and estimated time charts. Retrieved on September 18, 2008.from http://www.cde.ca.gov/ta/ 
tg/sr/documents/itemtimecharts08.pdf 

California Department of Education (n.d.). California STAR CST blueprints. Retrieved 
August 7, 2008 from http://www.cde.ca.gov/ta/tg/sr/blueprints.asp. 


Connecticut 


Connecticut State Department of Education (n.d.). Connecticut State Department of 
Education: Test accommodations form special education, modified assessment system 
(MAS) retrieved on August 7, 2008 from http://www.csde.state.ct.us/public/cedar/ 
assessment/mas/index.htm . 
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Kansas 



Kansas Department of Education (n.d). KAMM math studies test specifications. Retrieved 
on August 7, 2008 from http://www.ksde. org/Default.aspx?tabid=2371#KAMMitemandtest. 

Kansas Department of Education (n.d). KAMM reading test specifications. Retrieved on 
August 7, 2008 from http://www.ksde. org/Default.aspx?tabid=2371#KAMMitemandtest . 

Kansas Department of Education (n.d.). KAMM science test item Specifications. Retrieved 
on August 7, 2008 from http://www.ksde. org/Default.aspx?tabid=2371#KAMMitemandtest . 

Kansas Department of Education (n.d). KAMM social studies test specifications. Retrieved 
from http://www.ksde. org/Default.aspx?tabid=2371#KAMMitemandtest on August 7, 2008. 

Kansas Department of Education (n.d.). KAMM modified writing assessment manual. 
Retrieved August 7, 2008 from http://www.kansped.org/ksde/assmts/kamm/kamm.html . 

Kansas Department of Education (n.d). Kansas alternate assessment & Kansas 
assessment of modified measures (KAMM), fact sheet 2008-2009. Retrieved August 7, 
2008 from http://www.ksde. org/Default.aspx?tabid=2371#KAMMitemandtest . 

Kansas Department of Education (2007, November). Kansas State Department 
of Education accommodations manual: How to select, administer, and evaluate 
accommodations for instruction and assessment. Retrieved on August 7, 2008, from http:// 
www.ksde.org/Default.aspx?tabid=2371#Accommodations . 

Kansas State Department of Education (2007, May). Make a musical instrument. Retrieved 
on August 7, 2008. from http://www.ksde. org/Default.aspx?tabid=2371 . 

Kansas State Department of Education (n.d.). Sample problems illustrative of items based 
on modified academic achievement standards. Retrieved on August 7, 2008, from http:// 
www.ksde.org/Default. aspx?tabid=2371 . 

Kansas State Department of Education (2006, August 4). Act on cut scores for Kansas 
assessments. Press release letter from Bob Gorkins to Kansas State Board of Education. 
Retrieved on August 7, 2008. from http://www.ksde.Org/Portals/0/Special%20Education%20 
Services/assmts/kamm/PerfLevCutScores.pdf . 

Kansas State Department of Education (2007, February). Kansas assessments in reading 
and mathematics, 2006 technical manual for the Kansas general assessments, Kansas 
Assessments of multiple measures (KAMM), Kansas alternate assessment. Retrieved on 
August 7, 2008 from http://www.ksde. org/Default.aspx?tabid=2371. 

Kansas State Department of Education. (2008, July). Questions about the 2008-2009 
Kansas assessment of modified measures-KAMM. Topeka: Author. Retrieved on August 7, 
2008 from www.kansped.org/ksde/assmts/kamm/kammfaq.pdf . 

Kansas State Department of Education (n.d.). Kansas fact sheets on regular assessments. 
Retrieved August 7, 2008 from http://www.ksde. org/Default.aspx?tabid=420 and http://www. 
ksde.org/LinkClick.aspx?fileticket=P3OIVwqiJZg%3d&tabid=420&mid=5207. 

Kansas State Department of Education. (2007, October 24). Kansas reading education 
test specifications. Topeka: Author. Retrieved on August 7, 2008 from http://www.ksde.org/ 
Default. aspx?tabid=1 59. 
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Louisiana 


Louisiana Department of Education (n.d.). LAA2 accommodations 2008. Retrieved on 
August 29, 2008 from http://vwvw.doe.state.la.us/lde/saa/785.html . 

Louisiana Department of Education (n.d.). LAA2 test design. Retrieved on August 7, 2008 
from http://www.doe.state.la.us/lde/saa/2221.html . 

Louisiana Department of Education (n.d.). Special populations and accommodations for 
LEAP and GEE. Retrieved on August 29, 2008 from http://www.doe.state.la.us/lde/saa/785. 
html. 

Louisiana Department of Education (n.d.). Chapter 1 LEAP English language arts, grade 
4 [Assessment guides for other grades and content areas on same page]. Retrieved on 
September 18, 2008 from http://www.doe.state.la.us/lde/saa/1341.html 

Louisiana Department of Education (2007). LAA2 2006-2007 annual report. Retrieved on 
August 7, 2008 from http://www.doe.state.la.us/lde/saa/2221.html. 

Louisiana Department of Education (2007). 2006 LAA2 technical report summary. Retrieved 
on August 7, 2008, from http://www.doe.state.la.us/lde/saa/2221.html . 

Louisiana Department of Education (February, 2008). LAA2 LEAP alternate assessment, 
level 2, assessment guide: English language arts and mathematics. Grades 4, 8, 11. 
Retrieved on August 7, 2008 from http://www.doe.state.la.us/lde/saa/2221.html . 


Maryland 


Maryland State Department of Education (n.d.) School improvement in Maryland: HSA: high 
school assessment program, what is Mod-HSA? Baltimore: Author. Retrieved on October 
30, 2008, from http://mdk12.org/assessments/high_school/index_d2.html . 

Maryland State Department of Education (n.d.). Mod-HSA example items. Retrieved on 
October 30, 2008, from http://mdk12.org/assessments/high_school/index_d2.html . 

Maryland State Department of Education. (2006, October 1). 2006-2007 Maryland 
accommodations manual: A guide to selecting, administering, and evaluating the use 
of accommodations for instruction and assessment. Retrieved on August 7, 2008 from 
http://www.marylandpublicschools.org/NR/rdonlyres/840EFBB6-CD7D-404E-8A77- 
E978F6D508AA/1 1347/M DAccommodationsManual.pdf 

Maryland State Department of Education (2007). Technical documentation for the 
Maryland high school assessment program: Algebra/data analysis, biology, English, and 
government end-of-course assessments. Retrieved November 3, 2008 from http://www. 
marylandpublicschools.org/MSDE/divisions/planningresultstest/2006+HSA+Technical+Rep 
ort.htm 

Maryland State Department of Education (2008). 2007-2008 Maryland accommodations 
manual: A guide to selecting, administering, and evaluating the use of accommodations for 
instruction and assessment. Retrieved October 30, 2008 from: http://mdk12.org/share/pdf/ 
AccommodationsManual.pdf 
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North Carolina 


North Carolina Department of Public Instruction (2006, August 21). The North Carolina 
testing program, 2006-2007. Retrieved on September 3, 2008 from http://vwvw.dpi. state. 
nc.us/docs/accountability/NORTHCgeneralpolicies.pdf . 

North Carolina Department of Public Instruction (2007, July). Understanding the individual 
student report for the NCEXTEND2 EOG grades 3-8. Retrieved on August 7, 2008, from 
http://www.ncpublicschools.org/accountability/policies/briefs/ . 

North Carolina Department of Public Instruction (2008, July). North Carolina testing 
program assessment options, 2008-2009. Retrieved on August 7, 2008. from http://www. 
ncpublicschools.org/docs/accountability/policyoperations/nctpassessmentoptions.pdf . 

North Carolina Department of Public Instruction (2007, February). School test coordinator’s 
handbook. Retrieved on September 3, 2008, from http://www.ncpublicschools.org/docs/ 
accountability/policyoperations/stcHandbook.pdf . 

North Carolina Department of Public Instruction (2007, October). Test information sheets. 
Retrieved on October 17, 2008, from http://www.ncpublicschools.org/accountability/testing/ 
eog/reading. 

North Carolina Department of Public Instruction (2006, May). Test information sheets. 
Retrieved on October 17, 2008, from http://www.ncpublicschools.org/accountability/testing/ 
eog/math. 

North Carolina Department of Public Instruction (2007, November). Test information sheets. 
Retrieved on October 17, 2008, from http://www.ncpublicschools.org/accountability/testing/ 
eog/science. 

North Carolina Department of Public Instruction (2006, December). North Carolina end-of- 
course test of English 1. Retrieved on October 17, 2008, from: http://www.ncpublicschools. 
org/docs/accountability/testing/eoc/English 1/20071 201 englishtestinformationsheet.pdf . 

North Carolina Department of Public Instruction (2007, October). Test information: End- 
of-course (EOC) mathematics tests. Retrieved October 17, 2008, from http://www. 
ncpublicschools.org/docs/accountability/testing/eoc/Algebra1/MPGHW121EOCItemsbyGoal. 
pdf . 

North Carolina Department of Public Instruction (2007, October). North Carolina end-of- 
course test of biology. Retrieved October 17, 2008, from http://www.ncpublicschools.org/ 
docs/accountability/testing/eoc/scienceeocbiology.pdf. 


North Dakota 


North Dakota Department of Public Instruction (n.d.). North Dakota alternate 
assessments 2007-08 (PowerPoint presentation). Retrieved on August 7, 2008, from 
http://64. 233.1 67. 104/u/NDDPI?q=cache:JwKYLdw8SqMJ:www.dpi. state, nd.us/speced/ 
resource/alternate/ AA2ppt.pdf+NDAA&hl=en&ct=clnk&cd=5&gl=us&ie=UTF-8 . 

North Dakota Department of Public Instruction (n.d.). Comparison of NDAAI and NDAAII. 
Retrieved on August 7, 2008, from http://www.dpi.state.nd.us/speced/resource/alternate/ 
index. shtm . 

North Dakota Department of Public Instruction (September, 2008). Revised- students with 
disabilities and the North Dakota state assessments: Information for parents and educators 
(2008 NDAA Parent Brochure). Retrieved on August 7, 2008, from http://www.dpi. state, 
nd.us/speced/resource/alternate/index.shtm . 
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Oklahoma 



Garrett, S. (2007). Oklahoma school testing program (OSTP) Oklahoma modified alternate 
assessment program (OMAAP), test preparation manual. Retrieved on September 17, 

2008, from http://vwvw.sde.state.ok.us/AcctAssess/pdf/forms/OMAAP_TPM.pdf . 

Oklahoma Department of Education. (2008). Curriculum access resource guide- modified 
(CARG-M) modified priority academic student skills (PASS), reading, gr.3-5. Retrieved on 
August 7, 2008, from http://www.sde.state.ok.us/AcctAssess/OMAAP.html. 

Oklahoma Department of Education. (2008). Curriculum access resource guide- modified 
(CARG-M) modified priority academic student skills (PASS), reading and English II, gr 6-8. 
Retrieved on August 7, 2008 from http://www.sde.state.ok.us/AcctAssess/OMAAP.html . 

Oklahoma Department of Education. (2008). Curriculum access resource guide- modified 
(CARG-M) modified priority academic student skills (PASS), math, gr.3-5. Retrieved on 
August 7, 2008, from http://www.sde.state.ok.us/AcctAssess/OMAAP.html 

Oklahoma Department of Education. (2008). Curriculum access resource guide- modified 
(CARG-M) modified priority academic student skills (PASS), math and algebra I, gr 6-8. 
Retrieved on August 7, 2008 from http://www.sde.state.ok.us/AcctAssess/OMAAP.html . 

Oklahoma Department of Education. (2008). Curriculum access resource guide- modified 
(CARG-M) modified priority academic student skills (PASS), science and biology I, gr.5 and 
k Retrieved on August 7, 2008, from http://www.sde.state.ok.us/AcctAssess/OMAAP.html . 

Oklahoma Department of Education. (2008). Oklahoma modified alternate assessment 
program (OMAAP) mathematics & reading grade 3, parent, student, and teacher guide. 

[also grades 4-8] Retrieved on August 7, 2008, from http://www.sde.state.ok.us/AcctAssess/ 
OMAAP.html . 

Oklahoma Department of Education. (2008). Test administration manuals, (reading grades 
3-5, reading grades 6-8, math grades 3-5, math grades 6-8, science grades 5 and 8, 

English II, biology I and algebra I.) Retrieved on September 17, 2008, from http://www.sde. 
state . ok. us/AcctAssess/testad mi n . h tm I . 

Oklahoma Department of Education. (2008). Test blueprints, [grades 3-8, EOlj. Retrieved on 
August 7, 2008, from http://www.sde.state.ok.us/AcctAssess/OMAAP.html . 

Oklahoma Department of Education (n.d.). Test blueprints. Retrieved on August 7, 2008, 
from http://sde.state.ok.us/AcctAssess/core.html . 
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Texas 



Texas Education Agency (n.d.). Blueprints math TAKS-M. Retrieved August 7, 2008, from 
http://www.tea.state.tx.us/student.assessment/resources/taksm/index.html. 

Texas Education Agency (n.d.). Blueprints reading TAKS-M. Retrieved August 7, 2008, from 
http://www.tea.state.tx.us/student.assessment/resources/taksm/index.html. 

Texas Education Agency (n.d.). Blueprints science TAKS-M. Retrieved August 7, 2008, from 
http://www.tea.state.tx.us/student.assessment/resources/taksm/index.html. 

Texas Education Agency (n.d.). Blueprints social studies TAKS-M. Retrieved August 7, 

2008, from http://www.tea.state.tx.us/student.assessment/resources/taksm/index.html. 

Texas Education Agency (n.d.). Blueprints writing TAKS-M. Retrieved August 7, 2008, from 
http://www.tea.state.tx.us/student.assessment/resources/taksm/index.html. 

Texas Education Agency (2008, February). Modification guidelines for reading/ELAi. 
Retrieved August 7, 2008, from http://www.tea.state.tx.us/student.assessment/resources/ 
taksm/index.html. 

Texas Education Agency (2008, February). Modification guidelines for mathematics. 
Retrieved August 7, 2008, from http://www.tea.state.tx.us/student.assessment/resources/ 
taksm/index.html. 

Texas Education Agency (2008, February). Modification guidelines for science. Retrieved 
August 7, 2008, from http://www.tea.state.tx.us/student.assessment/resources/taksm/index. 
html. 

Texas Education Agency (2008, February). Modification guidelines for social studies. 
Retrieved August 7, 2008 from http://www.tea.state.tx.us/student.assessment/resources/ 
taksm/index.html. 

Texas Education Agency (2008, February). Modification guidelines for writing (revising and 
editing). Retrieved August 7, 2008, from http://www.tea.state.tx.us/student.assessment/ 
resources/taksm/index.html. 

Texas Education Agency (2008, March). Spring 2008 TAKS-M information brochure 
(English). Retrieved August 7, 2008, from http://www.tea.state.tx.us/student.assessment/ 
resources/taksm/index.html. 

Texas Education Agency (2008). TAKS-M Grades 3-5 test administration manual 2008: 
Writing, mathematics, reading, science, social studies. Retrieved on August 7, 2008, 
from http://www.tea.state.tx.us/student.assessment/resources/guides/test_admin/2008/ 
TAKSM08_3to5_TAM. pdf#xml=http://www.tea. state, tx.us/cgi/texis/webinator/search/xml.txt? 
query=administration+manual&db=db&id=c8e062206095b2b5 . 

Texas Education Agency (2008). TAKS-M grades 6-8 test administration manual 2008: 
Writing, mathematics, reading, science, social studies. Retrieved on August 7, 2008, 
from http://www.tea.state.tx.us/student.assessment/resources/guides/test_admin/2008/ 
TAKSM08_6to8_TAM. pdf#xml=http://www.tea. state, tx.us/cgi/texis/webinator/search/xml.txt? 
query=administration+manual&db=db&id=e0617822e4f5949f. 

Texas Education Agency (2008). TAKS-M grades 9-12 test administration manual 2008: 
Writing, mathematics, reading, science, social studies. Retrieved on August 7, 2008, 
from http://www.tea.state.tx.us/student.assessment/resources/guides/test_admin/2008/ 
TAKSM08_9to11_TAM.pdf#xml=http://www.tea.state.tx.us/cgi/texis/webinator/search/xml.txt 
?query=administration+manual&db=db&id=90e938497cb95e1 0 . 

Texas Education Agency (2008). TAKS blueprints. Retrieved August 7, 2008, from http:// 
www.tea.state.tx.us/student.assessment/taks/booklets/index.html. 

Texas Education Agency (2008). Texas student assessment program: 2008-2009 
accommodations manual: Guidelines for selecting, administering, and evaluating the use 
of accommodations. Retrieved on August 7, 2008 from http://ritter.tea.state.tx.us/student. 
assessment/admin/AccommManual_2007_08_tagged.pdf. 
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Appendix B 



AA-MAS Characteristics by State 



Table B1. Assessment Type and Question Characteristic by Content Area for States’ AA-MAS, 
2008 
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Shading indicates a state does not have a separate assessment for that content area. 

^Connecticut will implement in 2008-09. 

^Maryland will implement in 2008-09 at the earliest. 

^North Carolina also has occupational version that includes Occupational English I, Occupational Mathematics I, 
and Life Skills Science I and II. 

''The North Dakota assessment is done on computer with the student and teacher together. The test requires 
the teacher to enter the answer choice given by the student. Each question is presented on a single screen. 
Most questions are multiple choice with several teacher initiated questions (involves printing a screen shot of 
item, providing student with supplies to answer the item, give verbal instructions to student. The instructions are 
provided with the item and the teacher rates the student’s response from several options.) 
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Table B2. Comparison of AA-MAS and Regular Assessment: Design Changes, 2008 



State 


Design Change 


Distractor Removed 


Fewer Items 


Fewer Passages 


Segmenting of 
Passage 


Shorter Passages 


Simplified Language 


Other 


California 


X 


X 


X 




X 




X* 


Connecticut^ 




X 




X 




X 




Kansas 


X 


X 


X 




X* 


X 


X* 


Louisiana 




X 


X 




X* 


X 


X* 


Maryland^ 


X 


X 










X* 


North Carolina 


X 


X 






X 


X 


X* 


North Dakota 














X* 


Oklahoma 


X 


X 




X* 






X* 


Texas 


X* 


X 


X 


X* 


X* 


X* 


X* 


Total 


6 


8 


4 


3 


5 


5 


8 



‘See Table B3 for specifications and for descriptions of “other” design changes. 
^ Connecticut will implement in 2008-09. 

^ Maryland will implement in 2008-09 at the earliest. 
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Table B3. Specifications and Descriptions of Assessment Design Changes and of “Other” 
Assessment Design Changes, 2008 



State 


Specification Details and Other Design Changes 


California 


Other Desian Chanaes 

All Content Areas: One column for most items. 

Math: Graphics for most items. 

Science: Graphics for most items (stems and options). 


Connecticut^ 




Kansas 


Soecification Details 

Shorter Passages: Reduced sentence, paragraph and passage length. 

Other Desian Chanaes 

Reading/ELA: Use text with familiar/common topics to KAMM students, creating 
clear literal, explicit connections within text, organizing and formatting text to facilitate 
students’ processing of information related to overall purpose/theme (e.g., use of 
subheadings, bulleted lists, repetition of key words/information). 

Math: Reduced complexity of items in assessment (e.g., limiting decimal places 
to hundredths vs. thousandths on regular) and modifying other item specifications 
(e.g., provide graphic when appropriate; focus on the mathematical relationships, not 
solving for a missing part). 


Louisiana 


Soecification Detaiis 

Shorter Passages: Only at some grade levels (e.g., upper grades). 

Other Desian Chanaes 
Reading/ELA: No poetry. 

Writing: Prompt score uses two dimensions (composing and audience dimensions) 
of the six used in LEAP and GEE. Shorter response to writing prompt is required; 
For information resources section, questions are placed adjacent to the related 
resources. 

Math: Reading difficulty level of test questions is minimized except for necessary 
mathematical terms. 


Maryland^ 


Other Desian Chanaes 

Aii Content Areas: Administered as paper and pencil test or computerized version. 


North Carolina 


Other Desian Chanaes 

Writing: Grades 4 and 7 use the same prompts as regular assessment but are 
scored using modified achievement standards; Response booklet uses larger space 
between lines, with few lines overall on which to respond; Test booklets are modified 
with fewer printed lines (25 instead of 50), providing more white space in between 
lines for composing responses. 


North Dakota 


Other Desian Chanaes 

Aii Content Areas: Test is done on computer with the student and teacher together. 
The teacher enters the answer choice given by the student. Each question is 
presented on a single screen. Most questions are multiple choice with several 
teacher initiated questions (involves printing a screen shot of item, providing student 
with supplies to answer the item, give verbal instructions to student. The instructions 
are provided with the item and the teacher rates the student’s response from several 
options.) 
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State 


Specification Detaiis and Other Design Changes 


Oklahoma 


Soecification Detaiis 

Segmentation of Passages: Break apart passages into smaller portions and place 
the specific questions that pertain to the smaller portion underneath that section. 

Other Desion Chanoes 

All Content Areas: Eliminate questions that require students to select the better/ 
best answer; Eliminate answers choices that give students the option to make “no 
change” to the item. 

Reading: Display passages in one-column format. 

Writing: Simplify the question; Simplify the writer’s checklist; Use a 3-point holistic 
writing rubric. 

Math: Display the number on all sides for questions about perimeter; Avoid items 
with negative and positive answer choice of the same number (for example -4 
and +4) for lower grade levels; For lower grades use grids for area questions; Be 
consistent with qualifiers in stem and answer choices (i.e., use mL throughout or 
milliliters throughout); Avoid questions with best or closest, complicated art, and 
items that ask for students to redefine their perception of an object (i.e., fold this item 
along the dotted line). 

Science: Emphasize pictures over text; Simplify cells and other diagrams; Optimize 
readability; Highlight, if possible; Put a box around formulas to make them stand out. 


Texas 


Soecification Detaiis 

Distractor Removed: Delete one answer choice based on content and/or statistics 
of item. 

Reading/ELA: All other distracters must come from the associated part or a previous 
part; Revise answer choices as necessary to reflect modifications made to the 
selection. 

Segmentation of Passages: Divide the selection into meaningful thought units 
(parts) with items associated with that unit (part) immediately following it. 

Shorter Passages: Delete extraneous information that does not affect development 
of the selection or any context related to the tested items. 

Simplified Language: Change passive voice to active voice when appropriate; Add 
precise language to provide additional context for clarification; 

Reading: Simplify difficult to decode or conceptually difficult vocabulary, phrases, 
or sentences when not tested; Break compound/complex sentences into simpler 
sentences; Separate contractions except in cases where this makes the sentence 
awkward; Edit figurative language when not tested by using simpler sentences, 
plain language, and delete unnecessary words; Change item from an open-ended 
statement ending with a dash to a direct question or vice versa, as necessary for 
clarification. 

Math: Simplify complex sentence structure and vocabulary in item and answer 
choices without eliminating math vocabulary. 
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State 


Specification Details and Other Design Changes 


Texas (continued) 


Other Desian Chanaes 

All Content Areas: Delete items that cannot be assessed due to passage 
modifications; Simplify visual complexity of graphics; Revise answer choices to 
reflect modifications made to selection. Add precise language to provide additional 
context for clarification; Direct student attention to graphics; Other changes include 
horizontal item layout (full width), reduce the blueprint and delete all embedded field 
test item; Spanish-TAKS M tests are not currently available (no side by side versions 
with Spanish and English). 

Reading: Test administrator reads the pre-reading text to the students that 
clarifies purpose and explains difficult concepts and vocabulary; Delete one part 
of a compound answer choice when possible; Paired selections in grades 3-8 are 
not tested as thematically linked; Delete items that cannot be modified based on 
guidelines; Delete crossover items, items that test author’s organization of entire 
selection, and open-ended responses for reading selections in grades 9-11. 

Math: Reduce the number of variables and simplify digits in item when appropriate; 
Delete extraneous information including irrelevant material and unnecessary words 
in items or graphics; Change item from an open-ended statement to a direct question 
or vice versa, as necessary, for clarification; Use consistent language within an item 
in order to focus student attention on what is being asked; Revise text as necessary 
to maintain the authenticity and logic of the item due to modification; Provide new 
text and/or reorganize existing text within the question to explain or clarify the 
graphic; Provide additional graphics to support text, emphasize ideas, and facilitate 
comprehension; Reduce the number of variables and simplify digits in item when 
appropriate; Limit the number of steps and/or operations in multi-step problems; 
Provide explicit directions to explain a process such as measuring. 

Science: Delete one part of compound answer choices when possible; Delete 
cluster items, griddable items, negative items, and items that cannot be modified 
based on guidelines; Delete extraneous information including irrelevant material 
and unnecessary words in items or graphics; Simplify complex sentence structure 
and vocabulary in item and answer choices without eliminating science vocabulary; 
Change item from an open-ended statement to a direct question or vice versa, as 
necessary, for clarification; Add precise language to provide additional context for 
clarification; Use consistent language with an item in order to focus student attention 
on what is being asked; Provide appropriate formula and/or conversion from 
science chart near the item; Provide explicit directions to explain a process such 
as measuring; Limit the number of steps and/or operations in multi-step problems; 
Provide new text and/or reorganize existing text within the question to explain or 
clarify the graphic; Provide additional graphics to support text, emphasize ideas, 
and facilitate comprehension; Reduce the number of variable and simplify digits in 
items when appropriate; Limit the number of steps and/or operations in multi-step 
problems; Provide appropriate formula and/or conversion from science chart near 
item; Provide explicit directions to explain a process such as measuring. 

Social Studies: Provide explanatory text in brackets in historical excerpts 
(quotations); Simplify complex sentence structure and vocabulary in item and answer 
choices without eliminating social studies vocabulary; Change item from an open- 
ended statement to a direct question or vice versa, as necessary, for clarification; 

Use consistent language with an item in order to focus student attention on what 
is being asked; Revise text as necessary to maintain the authenticity of the item 
due to modifications; Provide explanatory text in brackets in historic excerpts 
(quotations); Provide additional graphics to support text, emphasize ideas, and 
facilitate comprehension; Provide new text and/or reorganize existing text with the 
question to explain or clarify the graphic; Delete items that cannot be modified based 
on guidelines. 



^ Connecticut will implement in 2008-09. 



^Maryland will implement in 2008-09 at the earliest. 
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Table B4. AA-MAS Embedded Accommodations, Selected States, 2008 



State 


Accommodation Incorporated into AA-MAS Assessment 
Design 


Breaks as Needed 


Calculator 


Fewer Items/Page 


Key Text Underlined/ 
Bolded/ 


Larger Font Size 


Manipulatives 


Read Aloud Questions 
and Answers 


Scribe 


Other 


California 






X 




X* 










Connecticut^ 




















Kansas 


X 






X 










X* 


Louisiana 






X 




X 










Maryland^ 




















North Carolina 






X 














North Dakota 




X* 








X* 




X* 




Oklahoma 






X* 


X 


X 










Texas 






X 


X* 


X* 




X* 




X* 


Total 


1 


1 


5 


3 


4 


1 


1 


1 


2 



‘See Table B5 for specifications and for descriptions of design changes. 

^ Connecticut will implement in 2008-09. Unable to determine if assessment will contain embedded 
accommodations. Detailed accommodations and test design information for this assessment was not available. 

^ Maryland will implement in 2008-09 at the earliest. Accommodations information for this assessment is not 
available. 
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Table B5. Specifications and Descriptions of Embedded Accommodations, 2008 



State 


Specification Details and Other Design Changes 


California 


Soecification Details 
Larger font: Helvetica sans serif. 


Connecticut^ 




Kansas 


Other Embedded Accommodations 
Bulleted List 


Louisiana 




Maryland^ 




North Carolina 




North Dakota 


Soecification Details 

Calculator and Manipulatives: Supplies given to student for assessment include 
pencil and paper, non-permanent marker, calculator, 12” ruler, number line 0-10, 
concrete math manipulatives (20), non-math text; book, number line from -7 to +7 
with .5 intervals (secondary only), and dictionary. 

Scribe: This test will be done on the computer with the student and the teacher 
together. The test requires the teacher to enter the answer choice given by the 
student. 


Oklahoma 


Soecification Details 

Fewer items per page: Minimize questions on the page (limit to 2). 


Texas 


Soecification Details 

Key Text Underlined/Bolded: Science and Social Studies: Provide definition of 
non-tested vocabulary in a text box near item and bold the defined term in the item. 
Reading: Provide definition of literary terms in a text box near the item and bold the 
defined term in the item. 

Larger Font Size: Larger point size, Verdana font. 

Read Aloud Questions and Answers: Oral administration is not available, but 
reading of test questions and items are part of the design of the reading and math 
assessments. 

Writing test: Pre-reading test only allowed; Due to the design of the revising and 
editing section of the writing test, orally reading the test questions and answers is 
not allowed. It is not possible to provide standard administration procedures that 
maintain the TEKS objectives for items such as misspelled words, homonym choice, 
irregular verb forms, or misplaced modifiers. 

Other Embedded Accommodations 

Bulleted List: Math, Science and Social Studies: Use bullets to clearly organize 
complex items into smaller, meaningful parts. 



^ Connecticut will implement in 2008-09. Unable to determine if assessment will contain embedded 
accommodations. Detailed accommodations and test design information for this assessment not available. 

^ Maryland will implement in 2008-09 at the earliest. Accommodations information for this assessment not 
available. 
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Appendix C 



Percentages of Items by Elementary, Middle, and High School Representative Grade 
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Table C1. Elementary Grade: Reading/ELAAA-MAS Assessments (Grade 4 unless otherwise noted, multiple choice unless otherwise noted) 
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Reading and Responding 
Multiple Choice 
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Total Multiple Choice 36-44^ 100% 50 100 % 





































































ELA Component Number of items Percent Number of items Percent 
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^ North Dakota included a range of items in their description of items per subject. 

Oklahoma listed an “ideal number of items” in their test blueprint. 

^ Percentage calculated based on number of items. 

Note: NA= Not Available 


















































^ Number of items not calculated for each strand due to combination of multiple choice and constructed response items included in percentages. 
^ North Dakota included a range of items in their description of items per subject. 

^ Oklahoma listed an “ideal number of items” in their test blueprint. 

Percentage calculated based on number of items. 

Note: NA= Not Available 
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Oklahoma Observe and measure 8-10^^ 22% 10 22 % 
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Table C4. Middle School Grade: Reading/ELAAA-MAS Assessments (Grade 8 unless otherwise noted) 
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Proofreading 

Total Multiple Choice 
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Punctuation, capitalization, spelling 
(revising and editing) 

Total Multiple Choice 
Total Constructed Response 









































































^ Percentages not calculated due to combination of multiple choice and constructed response items. 

2 North Dakota included a range of items in their description of items per subject. 

^ Percentages not calculated due to mixture of Grade 8 Reading/ELA items and Grade 7 writing items in li: 
Note: NA= Not Available 
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Total Multiple Choice 40 (all operational) 100% 





















































































Reading/ELA (English II EOl) 

Vocabulary 4-5^ 4-8^ 

Comprehension/critical literacy 9-11= 16-20= 

Literature 12-14= 17-20= 
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2 Percentages not calculated due to combination of multiple choice and constructed response items. 
= Maryland used a range to describe the number of items for each session. 

North Dakota used a range of items in their description of items per subject. 

= Oklahoma listed an “ideal number of items” in their test blueprint. 
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27% 


13% 


19% 


25% 


17% 


101% 




14% 


24% 


14% 


24% 


24% 


100% 




24% 


16% 


24% 


16% 


20% 


100% 




CO 


CD 


O) 


CM 


00 


00 






CM 


h- 


CM 


CM 


50 




CO 


(J) 


CO 




- 


55 




26% 


13% 


18% 


26% 


16% 


99% 




13% 


25% 


15% 


23% 


25% 


101% 




23% 


16% 


CO 

CM 


16% 


23% 


101% 




o 






o 


CD 


00 

CO 




ID 


o 


CD 


O) 


o 


40 




o 




O 




o 


44 


Social Studies, Grade 8 


History 


Geography 


Economics and social influences 


Political influences 


Social studies skills 


Total Multiple Choice 


Social Studies, Grade 10 


History 


Geography 


Economics and social influences 


Political influences 


Social studies skills 


Total Multiple Choice 


Social Studies, Grade 11 


History 


Geography 


Economics and social influences 


Political influences 


Social studies skills 


Total Multiple Choice 


Texas 
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Of these items, 18 are grade 5 items and 24 are grade 6. 

Of these items, 23 are grade 7 items and 26 are grade 8. 

Percentages not calculated due to combination of multiple choice and constructed response items. 
Maryland used a range to describe the number of items for each session. 



























